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Abstract 



Cellular automata are both computational and dynamical systems. 
\^ We give a complete classification of the dynamic behaviour of elemen- 

tary cellular automata in terms of fundamental dynamic system notions 
such as sensitivity and chaoticity. We conjecture that elementary cellu- 
lar automata capable of carrying out "complex" computational tasks are 
sensitive but not chaotic, i.e. at the "edge of chaos". 



^ 1 Introduction 

00 

^— s The theory of computation has an exceedingly rich and successful history. Its 

p^ models of computation, typically based on the Turing machine model, allow 

1^ to study the capacities of computational systems in great detail [D [2]. It is 

f^ however not quite clear how "computations" that occur in nature can be cast 

,-H in terms of the conventional theory of computation. One would like to ascribe 

^-H in some sense "computational" capacities to the intricate dynamics of systems 

'^ found in nature, especially to the dynamics of biological systems. To describe 

the dynamic behaviour of physical and biological systems, dynamical system 

theory seems a more appropriate framework. Hence, it is a promising approach 



rrt to study classes of systems or models that comprise in a generic manner both 

computational and dynamical system aspects. A paradigmatic class of such 
models are the cellular automata (CA). 

By definition, CA are discrete dynamical systems acting in a discrete space- 
time. The state of a CA is specified by the states of the individual cells of the 
CA, that is by the values taken from a finite set of states associated with the 
sites of a regular, uniform, infinite lattice. The state of a CA then evolves in 
discrete time steps according to a rule acting synchronously on the states in 
a finite neighbourhood of each cell. Despite the simplicity of these rules, CA 
can exhibit strikingly complex dynamical behaviour. A well-known example 



of a CA with intricate dynamics is the so-called Game of Life. CA have also 
been extensively applied as models for a wide variety of physical and biological 
processes. 

While being a class of discrete dynamical systems, CA are, evidently, also 
a mathematical model of massively parallel computation. Remarkably, already 
very simple rules can make a CA computationally universal, i.e. capable of 
carrying out arbitrary computational tasks. It is thus a natural and impor- 
tant question in what regard the computational capacities of CA relate to the 
dynamical system properties of CA. 

We will contribute to a more profound understanding of CA as both compu- 
tational and dynamical systems by clarifying the dynamical system properties of 
the most popular and best-studied class of CA, the so-called elementary cellular 
automata (EC A). Our approach is based on the symbolic dynamics treatment 
of CA initiated by the seminal paper of Hedlund [3]. The symbolic dynamics 
theory of CA allows to study the dynamical properties of CA by topological 
dynamics methods. 

Obtaining a dynamical system classification of ECA is part of the long- 
standing problem in CA theory to characterise the "complexity" seen inherent 
in CA behaviour. In a series of influential papers. Wolfram studied the dynam- 
ical system and statistical properties of CA and devised a classification scheme 
[H O |S]. According to this scheme, CA behaviour can be divided into the fol- 
lowing classes: 
(Wl) almost all initial configurations lead to the same fixed point configuration, 
(W2) almost all initial configurations lead to a periodic configuration, 
(W3) almost all initial configurations lead to random looking behaviour, 
(W4) localized structures with complex behaviour emerge. 
Wolfram's classification attempt was largely based on simulations of ECA. Since 
his pioneering work many more classification schemes have been proposed, e.g. 
by Li et al. ff] or Culik et al. |8j. It is however still an open problem of CA 
theory to obtain a completely satisfying, formal classification of CA behaviour. 

We put forward a complete topological dynamics classification of ECA. Such 
a classification uses the fundamental notions of dynamics system theory as e.g. 
sensitivity, chaos, etc. More specifically, it is based on a scheme introduced by 
Oilman [3] and modified by Kurka pTO^ which proposes four classes: Equicon- 
tinuous CA, CA with some equicontinuous points, sensitive but not positively 
expansive CA and positively expansive CA. Each one-dimensional CA belongs 
to exactly one class, but class membership is generally not decidable [lOJ. We 
determine for every ECA, as far as we know for the first time, to which class it 
belongs. We also (re-)derive further properties such as surjectivity and chaotic- 
ity of ECA. Taken together this gives a fairly complete picture of the dynamical 
system properties of ECA. 

The paper is organised as follows. In section [2] we introduce one-dimensional 
CA and ECA formally. In section[3]we give basic notations and definitions of the 
topological dynamics approach to CA. In section |4] we introduce a scheme that 
allows to express ECA rules algebraically. This will prove helpful in sections [5] 
and [6] where we will classify ECA in the topologically dynamics sense of Kurka. 



In section [7] we discuss our results. 



2 Definition of Elementary Cellular Automata 

We start with the definitions of the basic concepts underlying the theory of 
one-dimensional CA. The configuration of a one-dimensional CA is given by 
the double-infinite sequence x — {xi)i^z with Xi £ S being elements of the 
finite set of states S = {0,1,...}. The configuration space X is the set of all 
sequences x, i.e. X = S^. The CA map F, simply called the CA F, is a map 
F : X —>■ X where the local function is the map / : 5'^'"+^ — J- 5, r > 1, with 
F(x)i = f{xi-r,.-.,Xi,...,Xi^r)- The integer r is called the radius of the CA. 
The iteration of the map F acting on an initial configuration x generates the 
orbit X, F{x), F'^(x), ... of x. The orbits of all configurations x are a discrete 
space-time dynamical system also referred to as CA F. Instances of the system 
can be visualised in so-called space-time patterns. 

A spatially periodic configuration is a configuration which is invariant under 
translation in space, that is x is periodic if there is q > 1 such that a'^{x) — x 
where a : X ^ X is the shift map a{x)i — x^+i. A temporally periodic or 
simply periodic configuration x for some CA F is given if F^[x) = x for some 
n > 0. If F{x) = a;, a; is called a fixed point. A configuration x is called 
eventually periodic, if it evolves into a temporally periodic configuration, i.e. if 
pk+n^^-^ _ pk^^^ Jqj. gQjjjg fc > and n > 0. If this holds for any configuration 
X, the corresponding CA is called eventually periodic. 

An elementary cellular automaton (ECA) is an one-dimensional CA with 
two states and "nearest neighbourhood coupling", that is S* = {0, 1} and r = 1. 
There are then 256 different possible local functions f : S^ ^ S with F{x)i = 
f(xi-i, Xi, Xi+i). Local functions are also called rules and usually given in form 
of a rule table. An example is: 
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110 
IT 
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Every ECA rule is, following Wolfram [4J, referred to by the sequence of the 
values of the local function, as given in the rule table, written as a decimal 
number. In the example above one speaks of ECA rule 110, because 01101110 
written as a decimal number equals 110. 

3 Topological and Symbolic Dynamics Defini- 
tions and Concepts 

The framework we use to study the dynamical properties of ECA is given by the 
symbolic dynamics approach that views the state space S'^ of one-dimensional 
CA as the Cantor space of symbolic sequences. The topology of the Cantor 



Sixi,y^) 



space is induced by the metric 

+00 

2 — — 00 

where S{xi,yi) is the discrete metric 6{xi,yi) = < ' 

1^0, Xi^yi 

Under this metric the configuration space S^ is compact, perfect and totaUy 
disconnected, i.e. a Cantor space [11]. From now on, the configuration space 
S^ endowed with this metric will be referred to as X. The EGA functions F 
are continuous in X, hence {X, F) is a (discrete) dynamical system. 

Now we introduce some key concepts of the topological dynamics treatment 
of CA. A configuration x is an equicontinuity point of CA F if 

ye>0,36>0,yyeX ■.d{x,y) < 5, Vn > : d(F"(a;), F"(y)) < e. (1) 

If all configurations x ^ X are equicontinuity points then the CA is called 
equicontinuous. If there is at least one equicontinuity point, the CA is almost 
equicontinuous. 

A CA is sensitive (to initial conditions) if 

3e > 0, Va; e X, V(5 > 0, 3y e A : d{x, y) <5,3n>Q: d{F'\x) , F" (y)) > e. (2) 

A CA is positively expansive if 

3e > 0,Vx j^yeX,3n>0: d{F" (x) , F" (y)) > e. (3) 

Positively expansive CA are sensitive \TT\. 

CA as dynamical systems can be classified according to a classification in- 
troduced by Gilman [3] and modified by Kurka [TU] . Every one-dimensional CA 
falls exactly in one of the following classes [10] : 

(Kl) equicontinuous CA, 

(K2) almost equicontinuous but not equicontinuous CA, 

(K3) sensitive but not positively expansive CA, 

(K4) positively expansive CA. 
It has been shown that for one-dimensional CA it is not decidable if a given 
CA belongs to class (Kl), (K2) or (K3)U(K4), whereas it is open whether the 
class (K4) is decidable '12]. We will show that, in the case of ECA, it can be 
determined of each given ECA in which class it belongs. 

4 Algebraic Expressions of Elementary Cellular 
Automata Rules 

Here, we devise an algebraic expression scheme for ECA. The main idea is to 
derive in a consistent way algebraic expressions for the local ECA rules from a 



Boolean function form of EGA rules. The algebraic expressions of EGA rules 
are of use in the next sections. Algebraic expressions of specific EGA rules have 
been given before, usually of additive EGA rules (e.g. [13]), for example rule 90 
is usually given as F{x)i = Xi-i + Xi^i mod 2 [TT]. Other approaches, e.g. by 
Ghua [2], do not yield the same simple polynomial forms as proposed below. 
The approach taken here was first proposed by the authors in [TS]. As far as 
we know, it was the first time that simple, algebraic expressions for all EGA 
rules were given. Note that Betel and Flocchini used a similar approach in their 
study on the relationship between Boolean and "fuzzy" cellular automata [16]. 
The rule tables which define the EGA rules can be regarded as truth tables 
familiar from propositional logic. Any EGA rule hence corresponds to a Boolean 
function, which can always be expressed as a disjunctive normal form (DNF) (or 
a conjunctive normal form respectively) [IT]. The DNF of a Boolean function 
is a disjunction of clauses, where a clause is a conjunction of Boolean variables. 
Any EGA rule can thus be expressed as 

V A (-)^^". (4) 

where Xi+j are Boolean variables associated with the states of the cells in the 

neighbourhood of an EGA. For example the DNF expression of EGA rule 110 

reads to: 

(X,_i A X, A -X,+i) V (Xi_i A -^Xi A X,+i) V (-X,_i A X, A X,+i) V (-X,_i A 

X, A ^X,+i) V (-X,_i A -nXi A X,+i). 

The representation of EGA rules in DNF is well known and has e.g. be studied 

by Wolfram [15]. 

We however proceed now further by expressing the Boolean operations (A, V, ^) 
arithmetically as 

X Ay = xy (5) 

x\/'y = x + y — xy 
-^x = 1 — X. 

By these operations we attain from the Boolean algebra (A, A, V, ^, 1, 0) the 
Boolean ring (i?, +,—,-, 1, 0). We found it convenient to express the Boolean 
operations as defined above instead of using the usual (mod 2) operations. 

Replacing the Boolean operations in the DNF expressions of EGA rules with 
their arithmetic counterparts, we obtain for all EGA algebraic expressions, that 
is Boolean polynomials 



^PaX°' 



of the form 



Qfo + aiXi-i + a2Xi + a^Xi+i + a/^Xi-\Xi + a^XiXij^x + a^Xi-xXiJ^x + aTXi-\XiXij^\. 

(6) 



The coefficients cti S Z in (Ig]) completely determine the EGA rules. 

As examples we list here a few algebraic expressions of some interesting EGA 
rules. 

Rule 30: F{x)i = Xi^i+Xi+x^+i-2xi_iXi-XiXi+i-2xi_iXi+i + 2x^_ix^Xi+i 

Rule 90: F{x)i = Xi-i + Xi+i — 2xi-iXi+i 

Rule 108 

Rule 110 

Rule 184 

Rule 232 



\^)i — "^z I XiJ^\ XiXi-\.\ Xi—\XiXi-\-\ 
y^ji — •^i — 1 ^i~\'^i \ XiXi-^-X 

F\x)i = Xi^iXi + XiXiJ^i + Xj_iXj_|_i — 2xi-iXiXij^i 



Note how simple for example the algebraic expression of the " complex" EGA 
rule 110 is. 

As is well known the EGA rule space can be partitioned into 88 equivalence 
classes, because EGA rules are equivalent under the symmetry operations of 
exchanging left/right and 0/1 complementation. For the local function f{x)i = 
f{xi-i,Xi,Xi+i) these symmetry operations are given by T''^^*/"^'^^{f{x)i) = 
f{Xi+i,Xi,Xi-i) and T°/i(/(a;)j) = 1 - /(I - x^^i,! - x^,! ~ Xi+i). 

For example, for EGA rule 110 the equivalent rules are: 

Rule 110: F{x)i = Xi + Xi+i - x.,Xi+i - x^^iX^Xi+i 

Rule 137: F{x)i = l-Xi-i~Xi~'Xi+i+Xi^iXi + 2xiXi+i+Xi-iXi+i-Xi^iXiXi+i 

Rule 124: F{x)i — Xi^i + Xi — Xi^iXi — Xi-iXiXi+i 

Rule 193: F{x)i = l-Xt-i-Xi-Xi+i + 2xi-iXi+XtXi+i+Xi-iXi+i-Xi^iXtXi+i 

From now on we will refer to such a group of equivalent EGA rules solely by 
their lowest decimal EGA number. For example, by referring to EGA rule 110 
we actually refer to the four rules {110, 137, 124, 193}. 

Note that the approach developed here can be extended in various ways, for 
example to one-dimensional GA with state space {0, 1} but larger neighbour- 
hood or to two-dimensional GA with state space {0, 1}, etc. 

5 Classification of Elementary Cellular Automata 

We will now classify EGA in regard to their topological dynamics properties, 
that is according to the scheme introduced by Gilman 9J and modified by Kurka 

m- 

First, we need some more symbolic dynamics definitions and notions. A 
word M is a finite symbolic sequence u — uq...ui-i, with Ui G 5', where S' is a 
finite alphabet, e.g. in the case of EGA the state set {0, 1}. The length of u is 
denoted hy I = \u\. The set of words of S of length I is denoted by S\ the set of 
all words of S with Z > is 5'"*". The cylinder set [u\q of u consists of all points 
X E S^ whose initial part is u, i.e. [u]o — {x E S^ : X[qi^ — u}. 

A word u S S~^ with |it| > m,m > 0, is m-blocking for an one-dimensional 
GA F, if there exists an offset q e [0, |ii| — m] such that 



Vx,j/ G Mo,Vn > 0,i^"(a;)[q^,+„) = i^"(y)[,^5+,„). 

See Figure [T] It has been shown that one-dimensional CA, and therefore EGA, 
are either sensitive or almost cquicontinuous, the latter being equivalent to 
having a blocking word. 




q+m 




Figure 1: Blocking word. 



Proposition 1 (Kurka [H]). For any one- dimensional CA F with radius r > 
the following conditions are equivalent. 

(1) F is not sensitive. 

(2) F has an r-blocking word. 

(3) F is almost cquicontinuous. 

If a configuration x contains a m-blocking word u, then the sequence xr^ ,j_|_„j) , 
i.e. the states of the cells in the segment [q^q + m), are at all times indepen- 
dent of the initial states outside of the blocking word u. Hence, the following 
corollary holds. 

Corollary 2. For any one- dimensional CA F with radius r > the following 
conditions are equivalent. 

(1) F has a m-blocking word with m > r. 

(2) F has a word u G S^ with |u| > to, m > and an offset q G [0, |u| — to] 
such that^x G [u]o the sequence x\qq^„i\ is eventually temporally periodic. 



Proof. (1) => (2) : Denote the sequence a;[g^g+„i) of a blocking word u that is at all 
times independent of the initial states outside of u by w. The configuration x = 
(u)°° is spatially periodic and hence eventually temporally periodic. Because 
the sequence v is independent of the states of the cells outside of u, the sequence 
V is also eventually temporally periodic. 
(2) =^ (1): The condition (2) says that for all x G [u]o there is i > and p > 



such that F*~^P{x)[q^q^rn) = F* {y)[q.q+m) ■ Thus, for all x,y G [u]o and all n > 
the sequence F'^{x)[q^q+m) — F^{y)[q,q+m) must be independent of the initial 
states outside of w, hence the word u is m-blocking. D 

Now, we will look systematically for blocking words for EGA. We know by 
proposition [T] that whenever a blocking word can be found, the corresponding 
EGA is almost equicontinuous. By corollary [2] we know that this corresponds 
to finding a word u that contains a sequence that is eventually temporally 
periodic, independent of the initial states outside of u. As it turns out, we 
can thereby effectively determine all almost equicontinuous EGA, because any 
almost equicontinuous EGA corresponds to a blocking word u for which the 
length Z = |u| is bounded. 

Proposition 3. Each almost equicontinuous ECA has at least one blocking 
word of length / < 4. 

Proof. In the following, we look for blocking words, starting with the small- 
est possible length I = 1 and then successively for words of greater length (for 
a visualisation of the definition of a blocking word see again Figure [I]) . If a 
blocking word can be found, one or several almost equicontinuous EGA cor- 
respond to it. The EGA rules are specified by a rule table which we denote 
by (ioi ^11^21^37^47^57^67^7)- For example, EGA rule 110 is given by the table 
(0,1,1,0,1,1,1,0). If an entry in the rule table is left unspecified, the entry 
can take on either of the two values or 1, e.g. the table (0, 1, 1,0, 1, 1, 1,^7) 
refers to the two EGA rules 110 and 111. If a blocking word can be found, we 
put the corresponding EGA rule table in a list. A blocking word u and the 
corresponding rule table is denoted by tu^p = (^07^17^27^37^47^57^67^7)7 where p 
is the period with which the eventually periodic sequence in the word u (i.e. 
the sequence x\^qqj^„i) referred to in corollary [21) is repeated. For example, 
*oo,i = (^O7*i7i27 0,t4,t5,0,0) refers to the blocking word 00 of period p = 1 
that generates 2^ ECA rules, as denoted by the corresponding rule table. If a 
blocking word is found that corresponds to EGA rules which are generated by 
a rule table obtained by a blocking word already in the list (hence of smaller 
length), the word and its corresponding rule table is not listed. We also do not 
list blocking words and their corresponding rule tables if they generate EGA 
rules that are equivalent to EGA rules generated by a blocking word already in 
the list. 

Let us further assume the following notation: The variable Ci always denotes 
the states of cells i of a blocking word u that are at all times independent of 
the initial states of the cells outside of the blocking word u. The variable Xi on 
the other hand denotes the states of cells i that are in principle influenceable 
by the initial states of the cells outside of u. The state Xi of such a cell i 
is left undetermined, i.e. the value can either be or 1. If it is known for 
configurations x, y G [u\o that the states Xi and iji of some cell i differ, we write 

Xj. For example, the "scenario" ~ refers to two configurations 

x_i Co xi 

x,y €z [u\q that share the blocking word u = cq oi length / = 1 that is repeated 



with period p = 1. At the boundaries of the blocking word u, here at the cehs 
i = — 1 and i = 1, we can assume that the configurations x and y differ, which is 
denoted by X-i and Xi, whereas in the next time step this may not necessarily 
be the case anymore (at the cells i = — 1 and i — \). 

The proof has two parts. In part A, we determine all blocking words of 
length / < 4. In part B, we show that for any blocking word u of length I > 4 
there is a corresponding blocking word of length / < 4. 

Part A: Let us look at the cases (a) I = 1, (b) / = 2, (c) / = 3 and (d) I ~ 4, 
where I, as said, denotes the length of a blocking word u. 



X 

(a) With I = 1, the following scenarios are possible: (1) 


-1 Co xi 

1 Co Xi ' 


,2\ ^-1 Co xi ,g, x_i Co xi ,^, x_i Co xi ,g, 
Co Co xi ' ^ -^ x^i Co Co ' ^ '^ Co Co co ' ^ '^ 


x_i Co xi 
x-i Cq Xi ' 


(6) ^r' ? ^' , (7) ^-^ ? ^/ and (8) ^^ ? ^l 
c'_i c'^ Xl x_i c'^ c'l c'_i c[, c'l 


, where at least 



for one i, c^ ^ Ci. Note that there are further scenarios possible that how- 
ever do not yield further valid rule tables and are not listed here. Scenario 
(1) yields the rule table ti^i — (1,1,^2,^3,1,1,^65*7) (and the table to,i = 
(to,*i,0,0,t4,t5,0, 0), but as said, tables that generate EGA rules equivalent 
to already generated rules are not listed). Scenarios (2), (3) and (4) do not 
yield rule tables that generate EGA rules not already listed. For scenario (5), 

x_i Co xi x_i Co xi 

two cases have to be further distinguished: x_i Cq xi and x_i Cq xi , 

c'o Co 

where Cq 7^ co. The first case generates no new EGA rules. The second case 
yields the rule table ti_2 = (0, 0, 1, 1, 0, 0, 1, 1). Scenarios (6) and (7) yield rule 
tables already listed. Scenario (8) yields ti^2 — (0,0,0,0,0,0,0,1). 

(b) For / — 2, there are basically the same scenarios possible, in analogy to 
case (a). However, for reasons of space, we cannot discuss them here in detail 
and, from now on, only list the scenarios that effectively yield blocking words 

that generate rule tables not yet obtained. These are: (1) ~ 

X_l Co Cl X2 

and (2) ~ , , , where c^ 7^ c^. Scenarios (1) and (2) yield the 

X_l Cq c-^ X2 

following blocking words and rule tables: ioo.i — (io,ii, *2, 0, ^4, ^5,0, 0), ioi.i = 
(to,ii,0,t3,l,l,0,f7),tio,i = (to, 1,0, 0,^4, 1,^6,^7) and too,2 = (0,0,^2,1,0,^5,1,1), 
iio,2 = (to, 0,1, 1,0, 0,1,^7). 

(c) For I — 3, there are basically again scenarios in analogy to the cases 
(a) and (b) possible. The scenarios that effectively generate rule tables not 

X_i Co Ci C2 X3 

listed before are: (1) ^ and (2) x_i xq c'^ X2 X3 , 

X-l Co Cl C2 X3 

Co Cl C2 

where c'l 7^ ci. Scenario (1) yields the blocking words and rule tables toio,i = 
(to, ti,0,0,t4, 1,0,^7) and tioia = (to, 1, 0, ta, 1, 1, to, t7). Scenario (2) yields 



X_i 



Co 


Cl 


C2 


X?, 


Xq 


Cl 


^2 


X3 


Co 


Cl 


C2 





generating a rule table not yet listed is 



yielding 



iooo,2 = (0, 0,i2, 0, 0,0, 0, 1). Note that e.g. the scenario x_i 



does not generate new rule tables. 

(d) For / = 4, there are basically again scenarios in analogy to the cases (a), 
(b) and (c) possible. Effectively, the only scenario that leads to a blocking word 

X_i Co Cl C2 C3 X4 
X_i Co Cl C2 C3 X4 

the rule table ioiio.i = (io, 1, 0,0, 1,^5, Ojiy). Note again that e.g. the scenario 

X-i Co Cl C2 C3 X4 

X-i xq di C2 X3 Xi , where at least for one i c'^ ^ Ci, does not lead to 

Co Cl C2 C3 

new rule tables. 

With this we conclude Part A. Let us summarise the blocking words and the 
corresponding rule tables found so far: 



io.i = 


(to,ti,0,0,i4,i5,0,0) 


tl.2 


= (0,0,1,1,0,0,1,1) 


h.2 


= (0,0,0,0,0,0,0,1) 


tm.i ~ 


(io,il,t2,0,t4,t5,0,0) 


^01,1 = 


= (to,tl,0,t3,l,l,0,t7) 


^10,1 = 


= (to,l,0,0,t4,l,t6,t7) 


^00,2 = 


= (0,0,i2, 1,0,^5,1,1) 


^01,2 = 


= (to, 0,1,1,0,0,1,^7) 


^010,1 = 


= (io,ii, 0,0,^4,1,0,^7) 


^101,1 = 


= (io,l,0,t3,l,l,i6,i7) 


*000,2 


= (0,0,t2, 0,0, 0,0,1) 


^0110,1 


= (to, 1,0,0,1,^5,0,^7) 



Part B: In the general case, i.e. for ^ > 4, we can conclude in analogy to the 
cases already considered, i.e. the cases with I < 4, that the following scenarios 
could possibly lead to new blocking words: 



(1) 



(3) 



(4) 



(5) 



X-i 

X_l 

/ X_l 



Co 
Co 
Co 



Cl 
Cl 
Cl 



Q-2 
Q-2 



C/-1 
C/-1 



Xl 
Xl 



(2) 



X-1 Co 

C-1 Co 

Q_2 



Cl . 
Cl . 
Cl-1 



■ C/_2 

• C/_2 

Xl \ 



Cl-1 
Cl-1 



Xq-1 
Xq-1 



X-1 Co Cl 



Co 
c' 



Cl 

c' 



-1 

-1 

Cl- 



^ni—l 
\-m—l 



Cl-2 Cl-l Xl 



^1-2 



l-l 

I 

l-l 



Xl 
Xl 



(6) 



Co 

c' 



Cl 

c' 



1-2 

I 

1-2 



l-l 

J 

l-l 



Xl 
Cl 



Xl 

c' 



10 



/x. 



Co Ci 



Q-2 Cj_i 



(7) 



(8) 



Xl \ 



Xq-1 
Xq-1 



Cq-\-7n—l 



X-l Co 



Cl 



I-g-l 



V 



-9+1 
^9+1 
=9+1 



"q+rn- 



^q+7n—l 
•Xq-\-m — l 



Q-2 Q-1 



^q+m 



a;; \ 



/ 



with TO > 1 and where at least for one i^ c[^ Ci. 

Case (1) yields blocking words already listed, because for I > 4 the conditions 
to be satisfied in order to obtain a blocking word u are entailed in the conditions 
to obtain a blocking word u with I < 4. The same reasoning applies to cases (2), 
(3) and (4) . The basic reason that such a reduction is possible is due to the fact 
that the conditions to be satisfied in order to obtain a blocking word depend on 
the values of the boundary cells, here the values x_i and xi (respectively the 
values Xq^i and Xq+m in cases (3) and (4)), but not on the values of the cells to 
the left (of i = —1) and right (of i ^ I) oi the boundary cells, as can be checked 
with the scenarios treated in Part A. 

Let us then look closer at case (5). We will show that if there is a blocking 
word CiC2...c;_2Q-1j the word is repeated with periodp = 2, because if the word 
is blocking, the word at the next time step (in case (5)) must be ciC2...c/_2Q_i. 
The bar signifies that the state Ci of the cell i must change, i.e. Ci = (1 — Ci). 
Without loss of generality, we can consider only the 2^ boundary conditions for 
blocking words at successive time steps. That is, given the word ciC2...c/_2Q-i, 
we consider at the next time-step all the (2^ — 2) possible cases: ciC2...c/_2C/_i, 
ciC2...Q_2Q-i, etc., excluding the two cases ciC2...Ci_2Q-i and ciC2...c/_2C/_i. 
It suffices to consider the case ciC2...Ci_2Q_i. The other cases can be dealt 
with analogously. The temporal evolution of the EGA generates in this case the 
following scheme: 



x-i Co Cl 
a;„i Co Cl 
a;_i Co Cl 



X- 



Cq Cl 

i-i 

Co Cl 



Cl-2 
Cl^2 



Cl-1 



Xl 
Xl 



Cl-1 
Cl-2 cf_^ Xl 



^1-2 
^1-2 



4-1 
4-1 



Xl 
Xl 



The superscript denotes the time-step n. The third, fifth and sixth line are due 
to the fact that if the state of e.g. the cell Z — 2 at time step n = 2 would not 
change, one would obtain a blocking word of shorter length (/ — 1). By checking 
all 2^ possible values for the boundary states of the initial word CiC2...Ci_2Ci_i it 
can be shown that the above scheme cannot be satisfied. Thus, any initial word 
ciC2...c;_2Q-i evolves in the next time step into either the word ciC2...c;_2Q-i 
or the word ciC2...c;_2C/_i. In the first case, a blocking word of period p ~ 1 
is generated, in the second case, i.e. for p = 2, one can find a blocking word of 
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length I — 2, a.s can easily be shown. 

The case (6) can be reduced to the case already treated under (a (8)) in Part 
A, the case (7) to the case (5) and the case (8) again to the case treated under 
(c (2)) (or the example in (d) respectively) in Part A. 

With this we conclude our analysis. In Part A, we have identified all blocking 
words of length / < 4. For / > 2, we omitted, for reasons of space, the presenta- 
tion of the cases that do not lead to blocking words or to blocking words already 
identified. In Part B, we have concluded from the cases for / < 4 on the general 
form of the scenarios that could possibly lead to blocking words for I > 4. These 
general scenarios could then be reduced to the scenarios obtained for I < 4. One 
case (case (5)) required a separate treatment and was analysed by means of an 
example. 

To arrive at a complete list of blocking words for ^ < 4 and to exclude 
additional blocking words for I > 4, great care and efforts have been invested. 
Moreover, the completeness of the list was corroborated by extensively sampling 
the space of initial configurations, which yielded no additional blocking words. 
An explicit check of the completeness of the cases considered in our analysis 
would require the help of a computer, performing the analysis presented above 
on a case-by-case basis. Alternatively, to demonstrate the impossibility of addi- 
tional blocking words, the systems of equations generated from the conditions 
for blocking words and the algebraic expressions of EGA rules could be used, 
systematically evaluated for each single case. 

n 

The proof of proposition [3] allows to give, for EGA, a stronger version of 
proposition [l] Let us call a word u of length I invariant for an EGA F, if for 

all X (z [u]o, there is a p > such that FP{x)iqi\ — xiQiy 

Corollary 4. An ECA F is almost equicontinuous if and only if F has an 
invariant word. 

Proof. See the proof of proposition [3] D 

Proposition Is] (or corollary H respectively) allows to determine the almost 
equicontinuity of all EGA rules. The following list gives the invariant words 
of shortest length and the almost equicontinuous EGA rules corresponding to 
them. 

Corollary 5. Invariant words of period p = 1 and corresponding ECA rules: 

0: 0, 4, 8, 12, 72, 76, 128, 132, 136, I40, 200, 204 . 

00; 32, 36, 40, 44, IO4, 108, 160, 164, 168, 172, 232. 

01; 13, 28, 29, 77, 156. 

10; 78. 

010; 5. 

101; 94. 

0110; 73. 

Invariant words of period p = 2 and corresponding ECA rules: 

1: 1. 
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0; 51. 
00; 19, 23. 
01; 50, 178. 
000; 33. 

Conversely, we now also know the sensitive EGA rules. 

Proposition 6. The following rules are sensitive: 

2, 3, 6, 7, 9, 10, 11, 14, 15, 18, 22, 24, 25, 26, 27, 30, 34, 35, 37, 38, 41, 42, 
43, 45, 46, 54, 56, 57, 58, 60, 62, 74, 90, 105, 106, 110, 122, 126, 130, 134, 
138, 142, 146, 150, 152, 154, 162, 170, I84. 

Proof. Follows from Proposition [l] [3] and corollary [5] D 

The class of sensitive EGA is large, because in the Gantor space left- or 
right-shifting rules are sensitive. We return to this point later. 

From the almost equicontinuous EGA rules, we can further specify the 
equicontinuous ones. We use the following lemma. 

Lemma 7 (Kurka |11|). A one- dimensional almost equicontinuous CA F is 
either equicontinuous or almost equicontinuous but not equicontinuous. 
It is equicontinuous if and only if: 

(1) There exists a preperiod m > and a period p > 0, such that i^^+P — F"^ . 
It is almost equicontinuous but not equicontinuous if and only if: 

(2) There is at least one point x ^ X for which the almost equicontinuous CA 
F is not equicontinuous. 

Proposition 8. The following rules are equicontinuous: 
0, 1, 4, 5, 8, 12, 19, 29, 36, 51, 72, 76, 108, 200, 204. 

Proof. The proof is by showing that condition (1) of Lemma It] holds. We only 
give an example for a specific EGA rule. 

Rule 72 is equicontinuous with preperiod m = 2 and period p — 1, because, 
by using the algebraic expression for the local function, we obtain 

-^ \X)i Xi^iX'i -f- X^Xi^i ZXi—iXiXi^i 

^ V^)i — Xi — \Xi Xi—2'^i — l'^i''^i'^i-\-l ^Xi — \XiX'iJ^\~\-Xi—2Xi—\X'iXi-\-\ XiXj^-^-]^Xi^2~ 

Xi—\XiXi-\-\XiJ^2 

^ V /* — Xi — \Xi Xi~2'^i — l'^i'-^i'^i-\-l ^Xi — \XiXiJ^\~\-Xi — 2Xi—\XiXi-\-\ X iX i-\^\X iJ^2~ 

•^i—\-^i'^i-\-\Xi-\-2 • 

Hence, F^{x)^ = F^{x)i, Vi e Z. Thus, F^ = F^. D 

Proposition 9. The following rules are almost equicontinuous but not equicon- 
tinuous: 

13, 23, 28, 32, 33, 40, 44, 50, 73, 77, 78, 94, IO4, 128, 132, 136, 14O, 156, 
160, 164, 168, 172, 178, 232. 
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Proof. The proof is by showing that condition (2) of Lemma It] holds. We only 
give an example for a specific EGA rule. 

EGA rule 104 is almost equicontinuous but not equicontinuous, because 
(10)°° is not an equicontinuous point. 
Assume the configuration x = (10)°° and an integer q > such that 

Vy e X, (x[_,,g] = y[-q,q]) ^ {d{x, y) < 2~«). 

Assume that y differs from x at cells (— g — 1) and {q + 1), that is y-q-i = 
1 — X-q-i and yq+i = 1 — Xq+i. Then, as can easily be shown by using the 
algebraic expression of EGA rule 104, 

d{F'\x),F''{y)) <2-(«-") 

for all n > 0. Hence, EGA 104 is not equicontinuous at the point x — (10)°°. D 

From the sensitive EGA, we can distinguish further the positively expansive 
EGA. 

First, we need the definition of permutivity for EGA ^19^. An EGA F is 
left-permutive if (Vu € S'^), (V6 G S), (3!a G S): f{au) = b. It is right-permutive 
if (Vu e S'2), (yb € S), (3!a e S): f{ua) = b. The EGA F is permutive if it is 
either left-permutive or right-permutive. 

Then, we need the following lemma. 

Lemma 10 (Kurka llljl. A one- dimensional CA F is positively expansive if 
the following condition holds. 

(1) The CA is both left- and right-permutive. 

A one- dimensional sensitive CA F is not positively expansive if and only if the 
following condition holds. 

(2) There is no e > such that for all x ^ y £ X there is n > with 
d{F"ix),F^{y))>e. 

Proposition 11. The following EC A rules are sensitive but not positively ex- 
pansive: 

2, 3, 6, 7, 9, 10, 11, U, 15, 18, 22, 24, 25, 26, 21, 30, 34, 35, 37, 38, 41, 42, 
43, 45, 46, 54, 56, 57, 58, 60, 62, 74, 106, 110, 122, 126, 130, 134, 138, 142, 
146, 152, 154, 162, 170, 184. 



Proof. The proof is by showing that condition (2) of Lemma 10 holds. We only 
give an example for a specific EGA rule. 

EGA rule 110 is sensitive but not positively expansive. Assume the expansivity 
constant e = 2~'", then 

Va; ^ 2y e X ^ 3n > 0, F" (x) [_„,,,„] ^ F" (?/) [_„,„] (7) 

must hold. Assume the configuration x — (00110111110001)°° and an integer 
g > such that 14g > m. Then, for a configuration y E X that differs from x 
at the cells 14g, 14g -I- 1, lAq -I- 2, ([?]) does not hold. D 
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Proposition 12. The following EGA rules are positively expansive: 
90, 105, 150. 



Proof. For EGA rules 90, 105 and 150 condition (1) of Lemma 10 holds 



n 



For EGA left- and right-pcrmutivity is equivalent to positive expansivity. 

Proposition 13. EGA are positively expansive if and only if they are both left- 
and right-permutive. 



Proof. Follows from Proposition [6l [TT] and 12 



n 



Note that Proposition 13 does not hold generally for one-dimensional GA 



We summarize the findings of this section in the following table, which shows 
all EGA rules according to whether they have the property of equicontinuity, 
almost equicontinuity, sensitivity or positively expansivity. 



almost cquicontinuous 


sensitive 


equicontinuous 






positively expansive 


0, 1, 4, 5, 8, 


13, 23, 28, 32, 


2, 3, 6, 7, 9, 


90, 105, 150 


12, 19, 29, 36, 


33, 40, 44, 50, 73, 


10, 11, 14, 15, 




51, 72, 76, 108, 


77, 78, 94, 104, 


18, 22, 24, 25, 




200, 204 


128, 132, 136, 140, 


26, 27, 30, 






156, 160, 164, 168, 


34, 35, 37, 38, 






172, 178, 232 


41, 42, 43, 45, 

46, 54, 56, 57, 

58, 60, 62, 74, 

106, 110, 126, 130, 

134, 138, 142, 152, 

154, 162, 170, 184 





6 Classification of Sensitive Elementary Cellu- 
lar Automata 

The classification of the degree of "complexity" manifest in the space-time pat- 
terns generated by EGA rules has been in the center of GA research for many 
years. It is intuitively clear that the sensitivity property is a source of the ap- 
parent " complexity" of EGA behaviour. It would therefore be beneficial to have 
a finer classification of the sensitive EGA rules. 

We classify sensitive rules further according to whether they are eventually 
weakly periodic and/or surjective. The surjectivity property is actually sufficient 
to determine which EGA are chaotic (in the sense of Devaney [IS])- This fact has 
already been demonstrated by Cattaneo et al. |2T]. For the sake of completeness, 
we rederive the result here and propose the further subclass of the "eventually 
weakly periodic" and sensitive EGA. 
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A configuration x is called weakly periodic, if there is q G Z and p > such 
that FPa'^{x) = x [T^. We define a configuration x as eventually weakly periodic 
if there is q £ Z and n,p > such that F'^+Pa''{x) = F"(x). We call an EGA 
eventually weakly periodic, if the EGA is not eventually periodic, but for all 
configurations x eventually weakly periodic. 

Proposition 14. The following sensitive ECA rules are eventually weakly pe- 
riodic: 
2, 3, 10, 11, 15, 24, 34, 38, 42, 46, 138, 170. 

Proof. We demonstrate the proof by an example for a specific EGA rule. 

Employing the algebraic expression for EGA rule 10, it can easily be shown 
that F^cr~^(a;) = F{x) for all configurations x. 

Hence, EGA rule 10 is eventually weakly periodic with n = \,p = 1 and q = 
-1. D 

The classification of eventually weakly periodic EGA maps is not complete. 
There might be EGA which are eventually weakly periodic, but with such large 
n 01 p that prevents calculating the forward orbits as easily as in the proof of 
Proposition [14] 

We now look at the chaoticity of EGA maps. According to the often used 
definition of (topological) chaos by Devaney [5D], a map F : X ^ X is chaotic 
if F is sensitive, transitive and if the set of periodic points of F is dense in X. 

First, we study the surjectivity of EGA maps. This is actually sufficient to 
establish transitivity of F and the density of periodic points in X under F. 

A GA is surjective if and only if it has no Garden-of-Eden configurations, 
that is configurations which have no pre-image. A necessary (but not sufhcient) 
condition for surjectivity is that the local rule is balanced |TT]. For EGA rules 
this means that the local rule table contains 4 zeros and 4 ones. Further, any 
permutive GA is surjective II Ij. 

Proposition 15. The following ECA rules are surjective: 
15, 30, 45, 51, 60, 90, 105, 106, 150, 154, 170, 204. 

Proof. Apart from rule 51 and rule 204, the above listed rules are permutive, 
hence surjective. Rule 51 and rule 204 are surjective, because they are, trivially, 
bijective. 

For the EGA rules that are not listed, but satisfy the balance condition, it can 
be shown that they possess Garden-of-Eden configurations. For example, EGA 
rule 184 satisfies the balance condition, nevertheless it is not surjective, because 
any configuration containing pattern (1100) is a Garden-of-Eden as can easily 
be shown. D 

Next, we show that for EGA transitivity is equivalent to permutivity. An 
one-dimensional GA F is transitive if for any nonempty open sets, U,V '^ X 
there exists n>0 with F"(C/) n F ^ 0. 

Proposition 16. A ECA is transitive if and only if it is permutive. 
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Proof. Transitivity of one-dimensional CA implies its surjectivity and sensitiv- 
ity [TT]. From Proposition l6] and 15 we gain that EGA that are surjective and 



sensitive are permutive. For pcrmutive EGA either of the following two condi- 
tion holds: 

(1) for all open sets U G X there is n > such that F^{U) covers all of X, 

(2) the value of the local function f{xi^i,Xi,Xi+i) is determined by either the 
value Xi^i or Xi^i. 

If (2) does not hold, there is n > such that F^{U) covers, due to the permutiv- 
ity of F, all of X. Hence, F is in this case transitive. If (2) does hold, the local 
function / is given by the rule tables (1, 0, 1, 0, 1, 0, 1, 0) or (0, 0, 0, 0, 1, 1, 1, 1), 
i.e. the rules 170 or 15 (equivalent rules included). Rule 170 (15) is the shift- map 
F{x)i — Xi+i (for EGA rule 15: F{x)i = 1 — Xi^i), hence transitive. D 

Corollary 17. A EC A map is transitive if and only if it is surjective and 
sensitive. 



Proof. Follows from Proposition [6| [T5| and 16 D 



Next, we show that for EGA surjectivity implies that the set of periodic 
points of F is dense in X. 

Proposition 18. Surjective EGA have a dense set of periodic points in X. 

Proof. Surjective EGA are either almost equicontinuous or sensitive. Almost 
equicontinuous one-dimensional GA that are surjective have a dense set of pe- 
riodic points [22]. The sensitive EGA that are surjective are permutive and 
permutive one-dimensional GA are known to have a dense set of periodic points 
(through the property of closingness [H]). D 

A central open question of GA theory is the conjecture that for one-dimensional 
GA surjectivity implies a dense set of periodic points. For EGA the conjecture 
is answered in the positive. 

Hence, for EGA transitivity, or pcrmutivity, implies chaos. 

Corollary 19. The following EGA rules are chaotic in the sense of Devaney: 
15, 30, 45, 60, 90, 105, 106, 150, 154, 170. 

Figure [2] summarises these results. 

7 Discussion 

The results of this paper show that one can classify the dynamic behaviour of 
every elementary cellular automata (EGA) in terms of the standard notions of 
dynamical system theory, that is according to the classification proposed by 
Gilman [5| and Kurka (TUl. We also determined which EGA are chaotic in the 
sense of Devaney, rederiving a result by Gattaneo et al. ^21] . This gives a fairly 
complete picture of the dynamical system properties of EGA in the standard 
topology, as summarised in Fig. [2] The topological dynamics approach to GA 
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almost equicontinuoLB 



13,23,28,32,33,40,44, 
50,73,77,78.94,104, 
128,132,136,140,156, 
160,164,168,172, 178, 
232 



equicontinuc us 



0,1,4,5,8, 
12,19,29,36. 
72,76,108. 
200 



surjectlve 



30,45,60,106,154 



pos. 
expansive 



ev, weaki/ 



6,7,9,11,14,18.22,25, 

26,27,35,37,41,43,54 

56,57,58,62,74,110, 

126,130,134,142,152, 

162,184 



periodic 



2,3,10,24, 
34, 38, 42, 46, 
138 



Figure 2: Classification diagram for the elementary cellular automata (EGA). The chaotic 
EGA are inside the double-framed box. 



thus delivers a relevant and coherent account of the dynamical behaviour of 
EGA. 

In the light of our results, the class of "complex" EGA can be characterised as 
the class of EGA that are sensitive, but not surjective and not eventually weakly 
periodic. This class corresponds well to what one would intuitively regard as 
"complex" given the space-time patterns of EGA. In particular, the EGA rules 
of Wolfram's class (W4) seem to fall into this class. 

Among the EGA rules, a few deserve special interest from a computational 
point of view. The most prominent example is EGA rule 110 which has been 
shown to be computationally universal [S^. Based on our results we conjec- 
ture that sensitivity is a necessary condition of computational universality. In 
contrast, Wolfram conjectured that, for example, EGA rule 73, which is not sen- 
sitive, may be computationally universal |18| . This difference is due to the fact 
that our results hold generally for EGA without any restrictions on the initial 
conditions, whereas Wolfram considers specific sets of initial configurations on 
which the rule acts. On such a restricted set of configurations, EGA rule 73 
might indeed be sensitive. 

If a GA is sensitive, then its dynamics defies numerical computation for 
practical purposes, because a finite precision computation of an orbit may result 
in a completely different orbit than the real orbit. Hence, while sensitivity seems 
inherent to the in principle computationally most powerful rules, as e.g. rule 
110, their limited robustness to small changes in the initial conditions may 
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impair their practical usage in a physical or biological system: Even a single 
bit-flip in the input of a sensitive EGA may completely change the computed 
output. 

Among the many questions left open, a natural extension of our study would 
consist in giving a complete characterisations in the topological dynamics sense 
for more general CA than EGA. Examples by Gattaneo et al. [H] , however, show 
that the approach taken here to establish chaoticity can already fail in slightly 
more general settings. In the general case, long-term properties of GA and hence 
classification schemes based on these properties are typically undecidable. It 
would therefore be useful to pinpoint where exactly undecidability enters. 

Establishing a verifiable notion of computational universality in the Turing- 
machine sense in terms of necessary and sufficient conditions related to the 
dynamic behaviour of the underlying system would greatly advance our un- 
derstanding of the relation between computational and dynamic properties of 
physical and biological systems. Part of the problem to clarify this relation is 
that there is no unanimous accepted definition of computational universality 
for computational systems such as CA (See e.g. the discussion by OUinger (53] 
and Delvenne et al. [3S]. Delvenne et al. also prove necessary conditions for 
a symbolic system to be universal, according to their definition of universality, 
and demonstrate the existence of an universal and chaotic system on the Can- 
tor space.). To different definitions of universality, there might thus correspond 
different topological dynamics properties. Despite this fact, we conjecture that 
for EGA sensitivity and non-surjectivity are necessary conditions of universal- 
ity. This conjecture is in accordance with the intuitive idea that systems at the 
"edge of chaos", i.e. systems with neither too simple nor chaotic dynamical be- 
haviour, are the computationally relevant systems for biology. Such intermittent 
systems have, moreover, been characterised as having the largest complexity in 
the sense that their behaviour is the hardest to predict [37] . If computation is 
measured as a reduction of complexity |26j , the intermittent systems may then 
be said to provide the complexity needed for efficient computations. 

The extension of the results and observations from EGA to general one- 
dimensional GA or higher-dimensional GA is thus not without problems. Being 
much more tractable, EGA provide an important benchmark to test ideas on 
universality, the "edge of chaos" hypothesis and, generally, on how "computa- 
tion" occurs in nature. 
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